1
general::
Also, sit idly by. Refrain from interfering, remain passive, as in I can't just sit by and let her get in trouble.
American Heritage Idioms
2
general::
Phrase(s): sit by someone
to sit next to someone. • May I sit by you? • Come over here and sit by me.
McGrawhill's American Idioms And Phrasal Verbs